# High-precision quantization

Gama-12B is a large language model supporting multiple languages, offering various quantized versions to meet different performance and precision requirements.

A high-performance 7B parameter language model launched by NVIDIA, focusing on mathematical and code reasoning tasks and supporting a 128k context length.

A quantized version of the Austral-24B-Winton model of Delta-Vector, quantized using the llama.cpp tool, suitable for efficient operation on different hardware configurations.

This is the quantized version of OpenBuddy-R1-0528-Distill-Qwen3-32B-Preview0-QAT. With quantization technology, the model can run more efficiently under different hardware conditions.

A quantized version based on the infly/inf-o1-pi0 model, supporting multilingual text generation tasks, optimized with llama.cpp's imatrix quantization.

A multilingual, multi-purpose large language model supporting various professional domains and general tasks, suitable for role-playing, story creation, programming, and other scenarios.

This is a quantized version based on the Gryphe/Pantheon-Proto-RP-1.8-30B-A3B model, using llama.cpp for quantization, suitable for role-playing and text generation tasks.

Qwen3-14B-abliterated is a quantized version based on the Qwen3-14B model, optimized using llama.cpp, offering multiple quantization options to meet different performance requirements.

This is the quantized version of the Qwen3-14B-abliterated model, quantized using llama.cpp's imatrix option, suitable for text generation tasks.

Quantized version based on Qwen/Qwen3-32B, using llama.cpp for quantization, supporting multiple quantization types for different hardware requirements.

This is a 14B-parameter large mathematical language model open-sourced by NVIDIA. It has been quantized by llama.cpp and can run efficiently under different hardware conditions.

Mistral-Small-24B-Instruct-2501 is a 24B-parameter instruction-finetuned large language model supporting multilingual text generation tasks.

Llamacpp imatrix quantized version based on PocketDoc/Dans-SakuraKaze-V1.0.0-12b, supporting multiple quantization types, suitable for text generation tasks.

A 70B-parameter large language model based on the Llama 3.3 architecture, supporting multilingual text generation tasks, optimized through quantization for various hardware environments

Zero-Mistral-24B is a large language model based on the Mistral architecture, supporting Russian and English, suitable for dialogue and text generation tasks.

A quantized version based on Google Gemma 3's 27-billion parameter instruction-tuned model, generated using quantization-aware training (QAT) weights, supporting multiple quantization levels to meet different hardware requirements.

This is the quantized version of the NVIDIA Llama-3_1-Nemotron-Ultra-253B-v1 model, quantized using llama.cpp, supporting multiple quantization types and suitable for various hardware environments.

Llama-4-Scout-17B-16E-Instruct is a multilingual instruction fine-tuning model that supports multiple languages and can be run through LlamaEdge.

Qwen2.5-VL-32B-Instruct is a multimodal vision-language model with a parameter scale of 32B, supporting image understanding and text generation tasks.

GGUF format model converted from VIDraft/Gemma-3-R1984-27B, supporting multilingual text generation

Quantized version based on mlabonne/gemma-3-12b-it-abliterated model, using llama.cpp for imatrix quantization, suitable for text generation tasks.

This model is converted from google/gemma-3-12b-it to GGUF format, suitable for the llama.cpp framework.

Gemma-3-27b-it-GGUF is a quantized version based on Google's Gemma-3-27b-it model, suitable for image text-to-text tasks.

Gemma-3-4b-it-GGUF is a quantized version of Google's Gemma-3-4b-it model, enabling it to run on LlamaEdge and suitable for image-text to text conversion tasks.

Rombo-LLM-V3.1-QWQ-32b is a 32B-parameter large language model, processed with llama.cpp's imatrix quantization, offering multiple quantization versions to accommodate different hardware requirements.

Skyfall-36B-v2 is a 36B-parameter large language model, processed with llama.cpp's imatrix quantization, offering multiple quantized versions to accommodate different hardware requirements.

A quantized version based on the Steelskull/L3.3-MS-Nevoria-70b model, using llama.cpp for imatrix quantization, supporting multiple quantization levels for different hardware environments.

Sky-T1-32B-Preview is a 32B-parameter large language model, quantized using llama.cpp's imatrix, suitable for text generation tasks.

EXAONE-3.5-32B-Instruct is a large language model with 32B parameters, supporting instruction following and dialogue tasks.

Quantized version based on SicariusSicariiStuff/Impish_Mind_8B model, processed with llama.cpp tools for various quantization methods, suitable for text generation tasks.

Mini-Magnum-12B-V1.1 is a text generation model built on the basis of the intervitens/mini-magnum-12b-v1.1 base model, supporting English and adopting a specific quantization method.

This is a GGUF format model converted from Google's Gemma 2B model, suitable for text generation tasks.

A version completely remerged and remade based on the Dark Sapling V2 7B model, with a 32k context length, featuring ultra-high quality and 32-bit improvement

This is an 8B parameter instruction fine-tuned model based on Meta's Llama 3 architecture, processed with GGUF quantization, suitable for resource-constrained environments.

Quantized version of Mixtral-8x22B-v0.1, using llama.cpp for quantization, supporting multiple languages and quantization types.